Systems and methods to wirelessly meter audio/visual devices

ABSTRACT

Example systems and methods to wirelessly meter audio/visual (A/V) devices are disclosed. A disclosed example method receives media content from an A/V source device, embeds a video overlay in the wirelessly received media content, and wirelessly transmits the media content and the video overlay to the wireless A/V device. The example method wirelessly receives audience identification information in response to the transmitted video overlay, and wirelessly receives audience behavior information.

RELATED APPLICATIONS

This patent arises from a continuation of U.S. patent application Ser.No. 12/088,798, filed on Mar. 31, 2008, which arises from a 371 nationalstage of International Patent Application Serial No. PCT/US2006/061917,filed on Dec. 12, 2006, which claims the benefit of U.S. ProvisionalPatent Application No. 60/749,443, filed Dec. 12, 2005, all of which arehereby incorporated herein by reference in their entireties.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to metering audio/visual (A/V)devices, and, more particularly, to systems and methods to wirelesslymeter audio/visual devices.

BACKGROUND

Consuming media presentations generally involves listening to audioinformation and/or viewing video information such as, for example, radioprograms, music, television programs, movies, still images, etc.Media-centric companies such as, for example, advertising companies,broadcasting networks, etc. are often interested in audience behavior,such as the viewing and listening interests of their audience.Measurement of such audience behavior allows the media-centric companiesto better allocate their advertising expenditures and better markettheir products.

Audience measurement of television and/or radio programs has beenpracticed for many years. Audience measurement devices, installed instatistically selected households, typically collect tuning information(e.g., information indicating the content presented to the audience suchas channel information, time of consumption information, programinformation, etc.) and people information (e.g., information about thedemographics of the audience). Such information is gathered, recordedand combined to produce meaningful ratings data.

Tuning information is typically collected by a tuning meter, otherwiseknown as an active/passive (A/P) meter. The A/P meter collects thetuning data from devices, such as set-top boxes, video game devices,video cassette recorders (VCRs), digital video recorders (DVRs), anddigital versatile disk (DVD) players, to name a few. In addition tocollecting such tuning data, the A/P meter determines which of theseveral devices is feeding the television set. Channel and contentinformation, as well as device source information, is sent to abackoffice for analysis. People information is typically collected by aPeople Meter (PM) such as a Nielsen People Meter provided by NielsenMedia Research. The PM collects various demographic information relatedto the viewer and the viewer's tuning behavior. Together the A/P meterand the PM collect and send information to enable television ratings tobe determined. Such ratings information is useful for various businessdeterminations, including setting the cost of commercial advertisingtime.

Traditional audience measurement is typically employed by wire-based(fixed) hardware devices. An audio/visual (A/V) device, such as atelevision, is hard-wired to a media source cable to provide broadcastcontent to an audience member. Audience measurement devices may beplaced on or near the television to detect audio and/or video signalsemitted by the television, thereby allowing the devices to determineaudience behavior. Data acquired by the audience measurement devices ishardwired to a data collection facility by, for example, a telephonemodem or a broadband modem to allow further analysis of the collecteddata. However, the traditional audience measurement devices do notaccommodate audience measurement services when the A/V device iswireless, such as when the audience member(s) is using a wirelesstelevision.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example system to wirelessly meter anA/V device.

FIG. 2 is a block diagram illustrating further detail of one exampleimplementation of the system of FIG. 1.

FIG. 3 is a block diagram of an example wireless user identifier (WUI)of FIG. 2 that queries users A/V devices and receives user responses tothe queries.

FIG. 4 is a block diagram of an example wireless microphone receiver(WMR) of FIG. 2 that receives modulated RF signals and converts them toaudio signals.

FIG. 5 is a block diagram of an example mobile device interface (MDI) ofFIG. 2 that receives infrared signals and audio signals, and transmitsmodulated RF signals.

FIG. 6 is a flowchart representing an example process for implementingthe metering system of FIGS. 1-5.

FIG. 7 is a block diagram of an alternate example implementation of thewireless interface of FIG. 1.

FIG. 8 is a block diagram of an additional alternate exampleimplementation of the wireless interface of FIG. 1.

FIG. 9 is a block diagram illustrating an alternate exampleimplementation of the system of FIG. 1.

FIG. 10 is a block diagram of an example alternate wireless useridentifier (WUI) of FIG. 9.

FIG. 11 is a block diagram of an example personalized tag of FIG. 9 thatreceives audio signals, includes a personalized code with the audiosignals, and transmits modulated RF signals.

FIG. 12 is a flowchart representing an example process for implementingsignal transmission for the alternate example wireless user identifier(WUI) of FIG. 10.

FIG. 13 is a flowchart representing an example process for implementingthe example personalized tag of FIG. 11.

FIG. 14 is a flowchart representing an example process for implementingsignal reception and watermark detection of the alternate examplewireless user identifier (WUI) of FIG. 10.

FIG. 15 is a schematic illustration of an example processor system thatmay execute the processes of FIGS. 6 and 12-14 to implement the audiencemeasurement systems shown in FIGS. 1-5, 7, 8, and 9-11, respectively.

DETAILED DESCRIPTION

Referring now to FIG. 1, an example system 100 to wirelessly meter anaudio/visual (A/V) device is shown. The system 100 of FIG. 1 includes acentral data store 105, a data acquisition and home interface 110, awireless interface 115, and an A/V device 120. The central data store105 includes one or more databases, or other similar data storagedevices, accessible by an entity interested in collecting A/V deviceuser behavior information. Such user behavior information may includeuser identity, demographics, broadcast programming channels watched orlistened-to, movies watched, and A/V device channel changes, to name afew. User information collected at the central data store 105 may befurther analyzed at a backoffice, business, and/or marketing entity todetermine, for example, broadcast program ratings and movie ratings.Ratings information may allow advertisers to determine, among otherthings, effective advertising strategies and advertising pricing.

As discussed in further detail below, the data acquisition and homeinterface 110 includes devices typically found in a user's home, such asa cable television set-top box, a VCR, a DVD player, a video gamedevice, a satellite dish receiver, and various audio/visual devices (A/Vdevices) to name a few. Additionally, for households and viewersstatistically selected by a ratings company, such as, for example,Nielsen Media Research, the data acquisition and home interface 110 mayalso include a ratings data meter or similar A/V data aggregator tocollect and correlate data relating to users' behaviors. Further, thedata acquisition and home interface 110 may also include a device fordetermining and collecting demographic data of the household viewers viaan A/V data aggregator and/or user identification module/device (IDdevice), such as a Nielsen People Meter provided by Nielsen MediaResearch.

As discussed in further detail below, the wireless interface 115includes interfaces to allow a user to receive content provided by thedata acquisition and home interface 110. In particular, the wirelessinterface 115 permits the user to wirelessly transmit content from, forexample, the set-top box, VCR, and/or DVD player of the data acquisitionand home interface 110, to the wireless A/V device 120. In other words,the wireless interface 115 bridges the wireless gap between the user'sstandard A/V equipment (e.g., set-top box, VCR, DVD player, etc.) andthe A/V device 120 (e.g., a television, a mobile television, etc.). Asdescribed below, the wireless interface 115 may include a wireless useridentifier (WUI), a wireless access point (WAP), and a wirelessmicrophone receiver (WMR) to wirelessly transmit A/V content and receiveviewer behavior information, as discussed in further detail below.

The A/V device 120 includes one or more devices capable of providing A/Vinformation to a user. The A/V device 120 may include, but is notlimited to a television, a mobile television, a radio, and/or anentertainment center having audio and/or visual display devices. As theA/V devices are wireless, they are not constrained to use in an areaproximate to the data acquisition and home interface 110.

In operation, the system 100 to wirelessly meter an A/V device of FIG. 1allows the A/V device 120 to be located in a home or business without aconstraint of traditional cable-based connectivity to the dataacquisition and home interface 110. Such user freedom is provided, inpart, by the wireless interface 115, which also permits collection ofuser behavior while the A/V device 120 is being used. The user behavioris further collected and/or accumulated by the data acquisition and homeinterface 110 and provided to the central data store 105 for furtheranalysis. Because each of the central data store 105, data acquisitionand home interface 110, wireless interface 115, and A/V device 120 arecommunicatively connected, various types of data is exchanged therein.For example, the central data store 105 sends data acquisition requestsignals 125 to the data acquisition and home interface 110 to initiatereceipt of collected user data 130. The request signals 125 may betransmitted on a periodic basis and/or the data acquisition and homeinterface 110 may automatically transmit the collected user data 130 atpredetermined intervals. Collected user data may include, but is notlimited to channels watched and stations listened-to by a user of theA/V device 120, times and dates at which the user watched and/orlistened, and an identity of the user. The data acquisition and homeinterface 110 also receives programming content 127 from varioussources. For example, a cable television provider, a satellite serviceprovider, and/or a local broadcast station may provide programmingcontent 127 to the user.

Data 135 sent by the data acquisition and home interface 110 to thewireless interface 115 may include, but is not limited to, propagatingcontent, such as viewer programs from television signals, satellitesignals, cable signals, VCR A/V signals, DVD player A/V signals, andvideo game device A/V signals. The data 135 sent by the data acquisitionand home interface 110 may also include watermarks embedded into audioand/or video portions of the various A/V signals. The watermarks maycontain in-band codes of the programming transmission that identify thedate and time of broadcast, program identification information, and/oridentity information regarding the entity transmitting the program. Suchwatermarks are typically hidden into the audio and/or visual signal andare not perceptible to the A/V device user. In the event that astatistically selected household uses a wireless A/V device 120 (e.g., amobile television), the wireless interface 115 allows the devices of thedata acquisition and home interface 110 to transmit to the wireless A/Vdevice 120. Data received 140 by the data acquisition and home interface110 from the wireless interface 115 may include user identityinformation and extracted watermarks, as discussed further below.

Data 145 sent by the wireless interface 115 to the A/V device 120 mayinclude retransmitted viewer programming data and user query messages,as discussed in further detail below. Data received 150 by the wirelessinterface 115 from the A/V device 120 may include audio signals emittedfrom the A/V device 120 and processed by the wireless interface 115. Asusers interact (e.g., change channels on the example television) withA/V devices 120, the A/V device output is modulated by the wirelessinterface 115 and retransmitted to the A/V device 120. As discussed infurther detail below, the wireless interface 115 also sends userbehavior data and program content information to the data acquisitionand home interface 110. Additionally, the wireless interface 115 enablesthe system 100 to acquire demographics data from a A/V device user andsend such data to the data acquisition and home interface 110, and thenon to the central data store 105.

FIG. 2 illustrates further detail of one example implementation of thesystem 100 to wirelessly meter an A/V device of FIG. 1. Dashed-lines205, 210, and 215 in FIG. 2 separate FIG. 2 into componentscorresponding to the central data store 105, the data acquisition andhome interface 110, the wireless interface 115, and A/V device(s) 120,respectively.

The data acquisition and home interface 110 includes, as describedabove, various A/V devices, such as a set-top box 220, a video gameconsole 225, and a DVD player 230. Such example A/V devices (220, 225,230) provide various forms of audio and visual entertainment,information, and broadcast programs. As described above, the user mayreceive various forms of programming content 127, such as cabletelevision, satellite programming, and/or programming via an antennathat is broadcast from one or more local television stations. The usermay receive such programming content via the set-top box 220. The dataacquisition and home interface 110 also includes an example A/V dataaggregator 235 to collect user behavior and demographic information.

The wireless interface 115 includes a wireless user identifier (WUI) 240for receiving A/V signals from the A/V devices (220, 225, 230) andembedding an identification query signal on the received A/V signals, aswill be discussed in further detail below. The WUI 240 forwards the A/Vsignals, including the embedded query signal, to a wireless access point(WAP) 245 for wireless retransmission to a user's A/V devices 120. Thewireless interface 115 also includes a wireless microphone receiver(WMR) 250 for receiving retransmitted audio signals from the A/V devices120, as will be discussed in further detail below.

FIG. 2 also illustrates example A/V devices 120, such as a mobile A/Vdevice 255. An example mobile A/V device 255 may include, for example, amobile television that is unencumbered by wire-based data cables and/orpower cables. However, the example A/V device 120 may also include astandard television that connects to data cables and/or power cables.The example mobile A/V device 255 may also include a speaker 260 tooutput audible signals to the user, and an infra-red (IR) receiver 265to receive user commands (e.g., channel change, volume adjustment, poweron/off, etc.). The A/V devices 120 may also include a mobile deviceinterface (MDI) 270 for receiving audio signals from the mobile A/Vdevice 255 via a microphone 275. The MDI 270 may also include an IRreceiver 280, similar to that of the mobile A/V device 255, to receiveuser identification information from a user that is interacting with themobile A/V device 255. The IR receiver 265 of the mobile A/V device 255and the IR receiver 280 of the MDI 270 may each receive IR signals froman IR transmitter (remote control) 285.

A household with the metering system 100 of FIG. 2 includesbidirectional connectivity with the central data store 105.Bidirectional connectivity may include a connection via telephone, anInternet connection, satellite, and/or a cable network, such as a cablenetwork owned or leased by a content provider. The central data store105 may communicatively connect to the home interface 105 via an A/Vdata aggregator 235 of the data acquisition and home interface 110. Aswill be discussed in further detail below, the data aggregator 235receives information related to the behavior and identification of A/Vdevices 120 with which users interact, and forwards such information onto the central data store 105. To bridge the communicative gap betweenthe data acquisition and home interface 110 and the A/V devices 120, theexample wireless interfaces 115 of FIG. 2 are employed.

Signals from the various standard A/V devices, such as the set-top box220, are typically hardwired directly into a viewer's standardtelevision set (e.g., a television set plugged in to an electrical poweroutlet and connected to a co-axial data cable). However, viewers havingmobile televisions, for example, generally employ the use of a wirelessaccess point (WAP) to retransmit the television signal wirelesslythroughout the viewer's home. An additional example may includehousehold users with standard television sets that simply relocate thetelevision from one location to another location within the home. Ratherthan moving both the A/V data aggregator 235 and the televisiontogether, the example wireless interface 115 permits the A/V dataaggregator 235 functionality without concern for its proximity to thetelevision. Furthermore, the wireless interface 115 permits the A/V dataaggregator 235, as well as one or more devices of the wireless interface115 itself, to be located anywhere within the home, such as a basement,attic, closet, etc. The WAP may include 802.11 a/b/g communicationcapabilities, thereby permitting any signal from the data acquisitionand home interface 110 to permeate throughout the viewer's home orbusiness. Similarly, the A/V devices 120 (e.g., a mobile television) ina viewer's home may also include an ability to receive the transmittedsignal (e.g., 802.11 a/b/g).

Data acquisition in users' homes in which a standard wire-basedtelevision is viewed typically employ a hardwire connection from a wiredA/V device (e.g., a set-top box) directly to a non-mobile (standard)television. Additionally, the wired A/V device (e.g., a set-top box)typically includes a hard-wired connection to a data-aggregator so thatwhen the viewer changes the channel on the set-top box, the viewer seesthe results on the television, and the changes are captured by the dataaggregator. Furthermore, data acquisition in viewers' homes usingstandard televisions typically included a hard-wired ID device todetermine which member of a household was watching or interacting withthe standard A/V device. Each member of the household generally had anidentification button on the ID device, or if the ID device included anIR remote control, each member pressed an appropriate button on the IRremote control to identify who was watching the television. However,because a viewer of a standard or mobile television may be in any roomof the house or business, hard-wired ID devices and hard-wired data willnot allow for data acquisition or identification of the viewer.

A/V device mobility (e.g., standard televisions, wireless televisions,etc.), data acquisition of the user, and user identification isaccomplished, in part, by the example A/V interface 115 shown in FIG. 2.As briefly described above, the example A/V interface 115 includes thewireless user identifier (WUI) 240, the wireless access point (WAP) 245,and the wireless microphone receiver (WMR) 250. Generally speaking,signals transmitted by wire-based A/V devices (e.g., set-top box 220,video game console 225, DVD player 230, etc.) are received by the WUI240, which, in turn, integrate a bitmap image overlay on a videochannel. The bitmap image may be a message requesting that the viewerprovide immediate identification information. The WUI 240 forwards theintegrated A/V signal to the WAP 245 to modulate the A/V signal receivedby the WUI 240 (including the bitmap overlay) for wirelessretransmission to an A/V device 255, as shown by a dashed arrow labeled1. The A/V device 255, such as the example mobile television shown inFIG. 2, receives and demodulates the retransmitted signal back in to theA/V domain and presents the signal in an audio and/or video format tothe viewer (e.g., a movie, television program, etc.).

A user or viewer of the example mobile television 255 views theintegrated bitmap, which requests that the user provide identificationinformation. For example, after a viewer begins using an A/V device 220,225, 230, the WUI 240 transmits a video overlay stating, “Please selectyour identification button.” The user may provide such identificationfeedback via a remote control, such as an example infra-red (IR) remotecontrol 285 shown in FIG. 2. The IR remote 285 contains useridentification (ID) buttons for each of the viewers in the household(e.g., one button for each of “Jack,” “Jane,” and “Junior”), andtransmits ID selection information from the IR remote 285 to an IRreceiver 280 of the MDI 270, discussed in further detail below. The IRremote 285 may include other functionality to control the example mobiletelevision 255 by transmitting control commands to the IR receiver 265of the mobile television 255. Such control may include, but is notlimited to, changing channels, adjusting volume, and on/off powercontrol. User ID information may additionally or alternatively beprovided by user ID buttons located on the MDI 270.

User ID selection information is wirelessly transmitted from the MDI 270to the WUI 240, as shown by a dashed arrow labeled 2. The user IDselection information is transmitted from the WUI 240 to the A/V dataaggregator 235, and the WUI 240 removes the integrated bitmap imageoverlay on the video channel. After a predetermined amount of time, theWUI 240 may again apply the bitmap overlay image on the video signal toreconfirm who is using the mobile A/V device 255.

Various watermarks embedded within the audio of the programming contentpresented on the mobile A/V device 255 emanate from one or more speakers260. The audio watermark is imperceptible to the listener, and isreceived by the microphone 275 of the MDI 270. The audio signal receivedby the microphone 275 is RF modulated by the MDI 270 and transmitted tothe WMR 250, as shown by the dashed arrow labeled 3. Alternatively,persons of ordinary skill in the art will appreciate that the audiosignal may exit the mobile A/V device 255 as an electrical signal ratherthan an audible speaker output. For example, the mobile A/V device 255audio output may include RCA terminals (also referred-to as RCA jacks,phono plugs, etc.) to accommodate audio cables that connect to an audioinput of the MDI 270. Persons of ordinary skill in the art will alsoappreciate that the watermarks may be embedded within the video signalrather than, or in addition to, the audio signal. Modulated RF signalsreceived at the WMR 250 are demodulated to extract watermark informationbefore sending the watermarks to the A/V data aggregator 235 of the dataacquisition and home interface 110.

Although the A/V data aggregator 235 could simply receive such audiosignals containing the embedded watermarks directly from the devices(220, 225, 230), or directly from the WAP 245, receiving the audiosignals after they have been emitted by speakers 260 on an A/V device,such as the example mobile television 255, ensures the informationprovided to users of the audience measurement devices is a reflection ofviewer behavior and actual content displayed by the mobile A/V device255. For example, if the A/V data aggregator 235 received the audiosignals directly from the set-top box 220, video game console 225, orthe DVD player 230, then the received information may not reflect aviewer's interaction with the A/V device 255. Such a situation isparticularly problematic if the A/V device is a mobile television thatis not powered on, but the set-top box 220 may continue to transmitdirectly to the A/V data aggregator 235 (assuming a hard-wiredconnection directly from the set-top box 220 to the A/V data aggregator235). Alternatively, such a situation is also problematic if the set-topbox 220 is powered-on and transmitting its signal through the WUI 240and further retransmitted by the WAP 245, but the viewer of the examplemobile television 255 is, instead, tuned-in to a local televisionstation. As such, retransmission of the audio signals (including theembedded watermarks) from the television 255 ensures that informationreceived by the A/V data aggregator 235 is indicative of viewer behaviorand indicative of content actually displayed by the television 255.

The information collected regarding the user's viewing behavior anddemographics may be stored locally in the A/V data aggregator 235. Atpre-determined intervals, or upon external request to acquire data, theinformation collected from the A/V data aggregator 235 is sent by thedata acquisition and home interface 110 to the central data store 105 toprocess and determine ratings information.

The example WUI 240 of the wireless interface 115 of FIG. 2 is shown ingreater detail in FIG. 3. A/V signals from the A/V devices (220, 225,230) are received by an input A/V interface 305 and mixed with a bitmap(to accommodate the functionality of prompting for the user or viewerID) at a video overlay 310 before being retransmitted to an output A/Vinterface 315. A/V signals from the output A/V interface 315 continue tothe WAP 245 for retransmission to the A/V devices 120, as discussedabove. The example WUI 240 of FIG. 3 also includes a serial port 320 toallow control of a timer 325, control of a bitmap position control 330,and addition/deletion of a library of various bitmaps in a bitmapgenerator 335. Access to the serial port 320 may occur as needed, andtypically occurs once during WUI 240 set-up prior to installation in auser's home. For example, a technician may program the WUI 240 tocontain several different bitmap images, one for each member of ahousehold. One of the five bitmaps may be a message stating, forexample, “Mr. Smith, is that you?” or “Viewer, please identifyyourself.” The technician may also program the timer 325 to re-displaythe bitmap image at a predetermined interval of, for example, 44 minutesto confirm which member of the household is viewing the television. Atan expiration of the time interval, the timer 325 provides a triggersignal to the bitmap generator 335 to forward a bitmap to the videooverlay 310. Furthermore, the technician may program the positioncontrol module 330 to place each of the bitmap images on a particularcoordinate of the television.

The A/V signal from the output A/V interface 315, which includes theembedded bitmap, is received by at least one of the A/V devices 120(after retransmission by the WAP 245). After the user/viewer responds tothe request for identification (e.g., “Viewer, please identifyyourself.”), as discussed in further detail below, an RF signalcontaining viewer identification is received by an RF receiver 340. TheRF receiver demodulates the RF signal and forwards it to an IR signaldecoder 345 to extract identification information. For example, the IRsignal decoder 345 parses the received signal for the presence of an IDsignal of one of the members of the household, such as Mr. Smith. Uponconfirming that Mr. Smith, or any other member of the household,provided identification information, the IR signal decoder 345 signalsto the bitmap generator 335 that the image may be removed from theviewer's A/V device. Additionally, the IR signal decoder 345 providesthe extracted identification information to an ID output interface 350.As shown in FIG. 2, the ID output interface 350 connects to an “ID Info”cable and provides such viewer identification information to the A/Vdata aggregator 235. The example WUI 240 of FIG. 3 may be implemented inhardware and powered by a power supply 355, such as a standard AC/DCconverter. The example WUI 240 of FIG. 3 may also be implemented insoftware as machine readable instructions executed by: (a) a processorsuch as the processor 1512 shown in the example computer 1500 discussedbelow in connection with FIG. 15, (b) a controller, and/or (c) any othersuitable processing device.

The example WMR 250 of the wireless interface 115 of FIG. 2 is shown ingreater detail in FIG. 4. Retransmitted audio signals sent by thewireless A/V devices, as discussed in further detail below, includeembedded watermarks. As shown in FIG. 4, the WMR 250 includes an antenna405 to receive the retransmitted audio signal and an RF demodulator 410to demodulate the retransmitted RF signal. A low pass filter 415converts the demodulated digital signal to an analog audio signal, whichis passed to an analog audio output interface 420 for transmission tothe A/V data aggregator 235. The WMR 250 may connect to an electricalsocket of the viewer's home and includes a power supply 425. Typically,the WMR 250 is located in close proximity to the user's A/V dataaggregator 235, but one of ordinary skill in the art will appreciatethat the WMR 250 may be integrated within the A/V data aggregator 235 asa single unit.

As shown in FIG. 5, one implementation of the MDI 270 includes themicrophone 275 to receive audio signals presented by the A/V device 255,and a CODEC 510 to digitize (A/D) the received audio signals. An encoder515 allows the digitized signal to be addressed to a particulardestination, for example, the RF receiver of the WMR 250. The digitizedand encoded audio is modulated by an RF modulator 520 and sent to anantenna 525 for transmission to the WMR 250. As discussed above,watermarks contained in the audio presented by the A/V device 255 arecaptured by the microphone 275 and wirelessly transmitted by the MDI 270to the WUI 240. Additionally, the MDI 270 includes an IR receiver 280 toreceive IR transmissions from the IR transmitter 285 (as shown in FIG.2). The user/viewer identification selection is transmitted by the IRtransmitter 285, which contains the identity of who is using the A/Vdevice 255. Such IR transmissions are received by the IR receiver 280and, much like the encoder 515 for the audio signal, encoded by anencoder 530 for the IR signal containing user identificationinformation. The encoded IR signal is modulated to a radio frequency bythe RF modulator 520 prior to transmission to the WUI 240. As discussedabove, the WUI 240 receives and demodulates such user identificationsignal at an RF receiver 340, and is further decoded to identify theuser and remove the bitmap overlay from the video signal transmitted tothe A/V device 255.

In operation, the MDI 270 is a relatively small device with a powersupply 535 (e.g., a battery), thereby allowing it to easily andunobtrusively attach to the A/V device 255. People of ordinary skill inthe art will also appreciate that the MDI 270 may, alternatively, beintegrated into the A/V device 255. Acoustic signals presented by theA/V device 255 are received by the microphone 275 of the MDI 270,digitized (A/D) by a CODEC 515, encoded by the encoder 515, andmodulated to a radio frequency by the RF modulator 520. The modulatedand encoded signal is sent to the antenna 525 for transmission to theWMR 250. As described above in view of FIG. 4, the WMR 250 includes theantenna 405 to receive the modulated RF signal transmitted by the MDI270, demodulates it with the RF demodulator 410, converts the digitalsignal to analog audio with the low pass filter 415, and the analogaudio output connector 420 allows various cable connections to route theaudio signal to the A/V data aggregator 235. Such audio signals,including the embedded watermarks provided by network broadcasters,propagate from one or more of the A/V devices (220, 225, and 230) andare eventually provided to the A/V data aggregator 235. The embeddedwatermark signals of the audio signal are used by the A/V dataaggregator 235, or an entity associated with the central data store 105,to determine which program a user is receiving. The receiver 280 of theMDI 270 operates to receive IR signals from a user's IR remote control285. For example, while the IR remote control 285 may include standardcontrol buttons/commands (e.g., channel change, volume change, poweron/off, etc.), the IR remote control 285 may also include identificationbuttons. As described above, when the user sees a bitmap prompt such as,“Viewer, please identify yourself,” the user presses an appropriateidentification button on the IR remote control 285 (e.g., a buttonlabeled “Jane”). The identification signal from the IR remote control285 is received by the receiver 280 of the MDI 270 prior to beingencoded by the encoder 515. Much like the audio signal received by themicrophone 275, the encoded IR signal is modulated to a radio frequencyby the RF modulator 520 before being sent to the antenna 525 fortransmission to the WUI 240.

A flowchart representative of example machine readable instructions forimplementing the example system to wirelessly meter an A/V device ofFIGS. 1-5 is shown in FIG. 6. In this example, the machine readableinstructions comprise a program for execution by: (a) a processor suchas the processor 1512 shown in the example computer 1500 discussed belowin connection with FIG. 15, (b) a controller, and/or (c) any othersuitable processing device. The program may be embodied in softwarestored on a tangible medium such as, for example, a flash memory, aCD-ROM, a floppy disk, a hard drive, a digital versatile disk (DVD), ora memory associated with the processor 1512, but persons of ordinaryskill in the art will readily appreciate that the entire program and/orparts thereof could alternatively be executed by a device other than theprocessor 1512 and/or embodied in firmware or dedicated hardware in awell known manner (e.g., it may be implemented by an applicationspecific integrated circuit (ASIC), a programmable logic device (PLD), afield programmable logic device (FPLD), discrete logic, etc.). Also,some or all of the machine readable instructions represented by theflowchart of FIG. 6 may be implemented manually. Further, although theexample program is described with reference to the flowchart illustratedin FIG. 6, persons of ordinary skill in the art will readily appreciatethat many other methods of implementing the example machine readableinstructions may alternatively be used. For example, the order ofexecution of the blocks may be changed, and/or some of the blocksdescribed may be changed, substituted, eliminated, or combined.

The process of FIG. 6 begins at block 602 where the A/V data aggregator235 or WUI 240 initiates a time-based prompting period. Generallyspeaking, audience measurement systems and devices periodically verifywhether or not a user is actively interacting with (e.g., viewing) anA/V device. Sometimes a user may begin watching a program, a DVD, orplaying a game, but later walk away from the A/V device without turningit off. Periodic user reminders allow the audience measurement devicesto correlate acquired data with an indication of whether the user wasresponsive to a ‘presence query’ (indicating active use) ornon-responsive to a ‘presence query’ (indicating the A/V device may havebeen left on with no interactive user). The method waits (loops) if thetimebase does not expire (block 604), otherwise the method prompts thebitmap generator 335 for a specific user's message to be forwarded(block 606) to the video overlay 310. For example, a memory of thebitmap generator 335 may have a number of graphics (e.g., one for eachof “n” users), including a graphic that reads, “Jane, please acknowledgeyour presence.” The video overlay 310 integrates this graphic with theA/V signals input from at least one of the various devices (220, 225,230) at block 608. The WAP 245 receives the integrated signal andretransmits it (block 610) to the A/V device 255, where it is presentedto the user. If no response is received after a predetermined amount oftime after transmitting the bitmap message (block 612), the WUI 240determines if any additional known viewers have been queried (block614). If there are additional known viewers for a particular household,the WUI 240 may apply a bitmap prompt for a different known user (e.g.,“John, please acknowledge your presence.”) (block 616). Otherwise,control returns to block 604 as the A/V device 255 is treated asabandoned. After the next predetermined time period elapses, the methodmay repeat by prompting the bitmap generator 335 for a specific user'smessage to be forwarded (block 606) to the video overlay 310. One ofordinary skill in the art will appreciate that, rather than applyspecific user message bitmaps, a generic message may be displayed to anyuser to indicate the A/V device 255 is actively being used. However,such a non-customized query may require additional “yes/no” typequestions to ascertain the user's demographic information. For example,the WUI 240 may also initiate prompts stating, “Are you between the agesof 18-24?” and/or “Are you male?” etc.

A response from the user (block 612) is determined after the userpresses an identification button on the IR remote 285, which is capturedby the MDI 270. The MDI 270 receives the IR remote 285 signal andtransmits it back to the WUI 240 as an RF signal. As described above inview of FIG. 3, the RF signal is received by the RF receiver 340 anddecoded with the IR signal decoder 345. The decoder 345 then prompts thebitmap generator 335 to remove the bitmap message from the user's A/Vsignal (block 618). Additionally, the decoder 345 provides the useridentification information to the A/V data aggregator 235 via the IDinterface 350 (block 620). Control returns to block 604 and the methodrepeats after the next timebase elapses. One of ordinary skill in theart will appreciate that, while waiting for the next timebase to elapse(e.g., 44 minutes before the user is presented with another querymessage), the wireless interface 115 may continue to monitor userbehavior (e.g., channel changes, volume change, device used, etc.), aswell as monitor content information (e.g., watermark detection).

Persons of ordinary skill in the art will appreciate that the mobileinterface 115, including the WUI 240, the WAP 245, and the WMR 250 maybe combined or separated into various functional divisions withoutlimitation. Similar to FIG. 2, an alternate example wireless interface715 is shown in FIG. 7. Dashed arrows labeled 1 and 3 are consolidatedinto a single dashed arrow in FIG. 7 to represent an exampleconsolidation of the WUI and the WMR into a single module 720. Thecombined WUI and WMR module 720 receives all RF signals. Alternatively,each module may remain separate, as shown in FIG. 2, while designatingone of the modules to send and/or receive all wireless communication. Assuch, each of the separate modules may be interconnected via networkcables, or similar connectivity. Also similar to FIG. 2, an alternateexample wireless interface 815 is shown in FIG. 8. Dashed arrows labeled1, 2 and 3 are consolidated into a single antenna in FIG. 8 to representan example consolidation of the WUI, the WMR, and the WAP into a singlemodule 820.

FIG. 9 illustrates a block diagram of an alternate example system 100 towirelessly meter an A/V device of FIG. 1. FIG. 9 is the same as FIG. 2except for a personalized tag 970 in lieu of the MDI (identifier 270 ofFIG. 2) and an alternate WUI 940, as will be discussed below. All othercomponents of FIG. 9 that are similar to FIG. 2 are provided similaridentification numbers in a “900” series. Generally speaking, ratherthan employing a bitmap overlay on the A/V signal to elicit a userresponse, the WUI 940 inserts an imperceptible audio watermark in theA/V signal that is transmitted by the WUI 940 to the A/V device 955.Note that the watermark added by the WUI 940 is in addition to anywatermarks that may be added by network broadcasters for a purpose ofcontent identification, or otherwise. As such, the WMR 950 operates inthe same manner as the WMR 250 of FIG. 2, thus unaffected by thealternate example system 100 to wirelessly meter an A/V device of FIG.9. The personalized tag 970 is carried by the user or, due to its smallsize, conveniently attached to the A/V device 955. As shown in FIG. 9, amicrophone in the tag 970 picks up audio output from the A/V device 955,including the imperceptible watermark, and transmits that signal, plusan added identification signal, back to the WUI 940. If the WUI 940receives the watermark that includes the added identification signalinjected by the tag 970, the WUI 940 automatically provides the A/V dataaggregator 935 with user demographic information, thereby eliminating aneed to receive a manual prompt from the user to provide identification.The overlay bitmap instructions to the user, and subsequent userresponse, are effectively eliminated with the alternate example system100 to wirelessly meter an A/V device of FIG. 9.

FIG. 10 is a more detailed view of the example WUI 940 of FIG. 9.Similar to FIG. 3, the A/V signal passes through the WUI 940 via aninput A/V interface 1005 and an output A/V interface 1015, just as itdid in the example WUI 240 of FIG. 3. However, rather than inject abitmap overlay on to the video signal, the example WUI 940 adds apersonalized watermark signal to the audio portion of the A/V signalwith an audio encoder 1010. The A/V signal continues to the WAP 945where it is transmitted to the A/V device 955. Audio output from the A/Vdevice 955 is picked-up by the microphone(s) 985 of the tag 970 whichre-transmits the audio signal with the embedded watermark and the newidentification code, as will be discussed in further detail below. Whenthe personalized tag 970 transmits its RF modulated signal, the WUI 940decodes and receives it with an RF receiver 1040, and demodulates itwith an RF demodulator 1045. An audio decoder 1050 looks for thewatermark that it originally added to the audio signal and, if thewatermark is detected, the WUI 940 generates a signal to the A/V dataaggregator 935 via an ID interface 1055 and the “ID Info” line, as shownin FIG. 9. Such signal also includes the personalized identificationcode added by the tag 970, thereby allowing demographic information tobe correlated to user behavior. Other signals that may occupy the sametransmission frequency are ignored because they are not deemed to beassociated with the WUI 940.

FIG. 11 is a more detailed view of the example tag 970 of FIG. 9. Thepersonalized tag 970 is a small battery 1100 operated device that mayeasily and unobtrusively attach to the A/V device 955. Alternatively,the personalized tag 970 may be carried by the user in a shirt pocket,clothing clip, or hung around the user's neck on a strap while using theA/V device 955. Inputs to the tag 970 include audio from the microphone785 and tag configuration data via a data port 1105. Before the tag 970is used by a user of a statistically selected household, the data port1105 allows configuration of an identification code to be saved to a tagmemory 1110. One of ordinary skill in the art will appreciate that thedata port 1105 may include a serial port, network cable, wirelesstransceiver, or similar known data communications connection. Eachidentification code is unique to each statistically selected user andalso saved in a database of the organization acquiring user data (e.g.,Nielsen Media Research). Post processing of the collected user behaviordata references the identification code to correlate the specific userdemographics with the user behavior.

Audio output (including the watermarks injected by the WUI 940) by theA/V device 955 of FIG. 9 is picked-up by the microphone 775 and providedto a CODEC 1115 for digitizing (A/D conversion). The memory 1110provides the personalized identification code to the CODEC 1115 so thatit may be added to the digital signal modulated by an RF modulator 1120and wirelessly transmitted via an antenna 1125. Such an identificationcode allows a recipient of the RF modulated signal to identify whichuser is using the A/V device 955.

A flowchart representative of example machine readable instructions forimplementing the alternate WUI 940 of FIG. 10 is shown in FIG. 12.Although the example program is described with reference to theflowchart illustrated in FIG. 12, persons of ordinary skill in the artwill readily appreciate that many other methods of implementing theexample machine readable instructions may alternatively be used. Forexample, the order of execution of the blocks may be changed, and/orsome of the blocks described may be changed, substituted, eliminated, orcombined.

The program of FIG. 12 begins at block 1202 where the WUI 940 inserts awatermark in all incoming audio of an A/V signal received from thedevices (e.g., 920, 925, 930). The encoded A/V signal is transmitted tothe WAP 945 (block 1204) where it is further transmitted to an A/Vdevice, such as a standard television or an example wireless television955 of FIG. 9.

A flowchart representative of example machine readable instructions forimplementing the tag 970 of FIG. 11 is shown in FIG. 13. The program ofFIG. 13 begins at block 1302 where the tag 970 determines if it isassociated with an ID. If the tag does not have an ID in the memory1110, an ID is programmed into the memory 1110 at block 1304. Atechnician may access the memory 1110 via the data port 1105 to programa predetermined ID for at least one member of a household for which thetag 970 will be used. After the tag 970 is associated with an ID, or ifthe tag 970 already has an associated ID, program control advances toblock 1306. If the tag 970 is within audible proximity to the A/V device955, the microphone 775 will receive the audio signals from the A/Vdevice speakers, including the embedded watermark containing thepersonalized identification code from the WUI 940. Additionally, the tag970 combines or modulates received audio with the ID via the CODEC 1115.At block 1308, the combined audio is RF modulated by the RF modulator1120 and transmitted via the antenna 1125. The signal transmitted atblock 1308 includes both the personalized identification code combinedby the tag 970, the personalized identification code from the WUI 940,and any other embedded watermarks (e.g., from a network broadcastercontaining program identification information). The behavior of the WMR950 does not differ from that discussed earlier in view of FIG. 2, andwill not be repeated here.

FIG. 14 is a flowchart representative of example machine readableinstructions for implementing the alternate WUI 940 of FIG. 10. Unlikethe flowchart of FIG. 12, which generally described an example of A/Vsignal throughput from A/V devices (e.g., the set-top box 920), theflowchart of FIG. 14 illustrates example signal receipt by the WUI 940.The WUI 940 receives and demodulates RF signals with the RF receiver1040 and RF demodulator 1045, respectively, at block 1402. The audiodecoder 1050 decodes the demodulated signal at block 1404, and if thepersonalized watermark, which was earlier embedded by the WUI 940 beforetransmission to the A/V device 955, is not detected at block 1406,program control advances to block 1404 to continue searching for thepersonalized watermark. If the personalized watermark is detected atblock 1406, indicating that the personalized tag 970 for a householdviewer is viewing an A/V device, the identification information isforwarded to the ID interface 1055 at block 1408.

As shown by FIGS. 12-14, if the viewer is not watching the television955, or has stepped out of the room from which the television 955 waslocated, the tag 970 will not transmit the embedded ID. In such asituation, the tag 970 properly prevents invalid viewing data from beingrecorded and/or forwarded to the A/V data aggregator 935. However, ifthe viewer returns to a viewing proximity of the television 955, the tag970 carried by that viewer may again receive the audio signals from thetelevision speakers with the tag microphone 985. Because the tag 970automatically and passively identifies the viewer of the television 955,the example alternate wireless interface of FIGS. 9-11 effectivelyeliminate the need for the viewer to manually respond to visual cues inorder to provide identification information to the A/V data aggregator935.

FIG. 15 is a block diagram of an example computer 1500 capable ofimplementing the apparatus and methods disclosed herein. The computer1500 can be, for example, a server, a personal computer, a set top box,or any other type of computing device. The system 1500 of the instantexample includes a processor 1512 such as a general purpose programmableprocessor. The processor 1512 includes a local memory 1514, and executescoded instructions 1516 present in the local memory 1514 and/or inanother memory device. The processor 1512 may execute, among otherthings, the example machine readable instructions illustrated in FIGS. 6and 12-14. The processor 1512 may be any type of processing unit, suchas a microprocessor from the Intel® Centrino® family of microprocessors,the Intel® Pentium® family of microprocessors, the Intel® Itanium®family of microprocessors, and/or the Intel XScale® family ofprocessors. Of course, other processors from other families are alsoappropriate.

The processor 1512 is in communication with a main memory including avolatile memory 1518 and a non-volatile memory 1520 via a bus 1522. Thevolatile memory 1518 may be implemented by Synchronous Dynamic RandomAccess Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUSDynamic Random Access Memory (RDRAM) and/or any other type of randomaccess memory device. The non-volatile memory 1520 may be implemented byflash memory and/or any other desired type of memory device. Access tothe main memory 1518, 1520 is typically controlled by a memorycontroller (not shown) in a conventional manner.

The computer 1500 also includes a conventional interface circuit 1524.The interface circuit 1524 may be implemented by any type of well knowninterface standard, such as an Ethernet interface, a universal serialbus (USB), and/or a third generation input/output (3GIO) interface.

One or more input devices 1526 are connected to the interface circuit1524. The input device(s) 1526 permit a user to enter data and commandsinto the processor 1512. The input device(s) can be implemented by, forexample, a keyboard, a mouse, a touchscreen, a track-pad, a trackball,isopoint and/or a voice recognition system.

One or more output devices 1528 are also connected to the interfacecircuit 1524. The output devices 1528 can be implemented, for example,by display devices (e.g., a liquid crystal display, a cathode ray tubedisplay (CRT), a printer and/or speakers). The interface circuit 1524,thus, typically includes a graphics driver card.

The interface circuit 1524 also includes a communication device such asa modem or network interface card to facilitate exchange of data withexternal computers via a network (e.g., an Ethernet connection, adigital subscriber line (DSL), a telephone line, coaxial cable, acellular telephone system, etc.).

The computer 1500 also includes one or more mass storage devices 1530for storing software and data. Examples of such mass storage devices1530 include floppy disk drives, hard drive disks, compact disk drivesand digital versatile disk (DVD) drives.

Although certain example methods, apparatus, and articles of manufacturehave been described herein, the scope of coverage of this patent is notlimited thereto. On the contrary, this patent covers all methods,apparatus and articles of manufacture fairly falling within the scope ofthe appended claims either literally or under the doctrine ofequivalents.

What is claimed:
 1. A method to selectively collect audio-based media ina household, comprising: embedding, within the household, a firstwatermark in media from a household source media device; wirelesslyretransmitting the media with the first watermark via a wireless accesspoint in the household; detecting audio output from a local presentationdevice; identifying the audio output as unassociated with the householdsource media device when the first watermark is absent from the audiooutput; and associating the audio output with the household source mediadevice when the first watermark is detected in the audio output.
 2. Amethod as defined in claim 1, further comprising detecting a secondwatermark in the audio output from the local presentation device, thesecond watermark associated with broadcaster generated identificationinformation.
 3. A method as defined in claim 2, further comprisingdetermining the local presentation device is tuned to a local broadcaststation when the second watermark is detected and the first watermark isabsent from the audio output from the local presentation device.
 4. Amethod as defined in claim 2, further comprising determining thehousehold source media device is not sourcing the audio output detectedfrom the local presentation device when the second watermark is detectedand the first watermark is absent.
 5. A method as defined in claim 1,further comprising monitoring the audio output from the localpresentation device for a personalized identification code accompaniedwith the first watermark.
 6. A method as defined in claim 5, wherein thepersonalized identification code is associated with viewer demographicinformation.
 7. A method as defined in claim 1, wherein the localpresentation device comprises a handheld electronic device.
 8. A methodas defined in claim 1, wherein the local presentation device receivesthe media from the household source media device wirelessly via thewireless access point.
 9. A method as defined in claim 1, wherein thehousehold source media device comprises at least one of a set-top box, avideo game console, a digital video recorder, or a digital versatiledisk.
 10. A method as defined in claim 1, wherein the wireless accesspoint wirelessly retransmits the media to the household presentationdevice via an 802.11 compliant signal.
 11. An apparatus to selectivelycollect audio-based media in a household, comprising: a wirelessinterface to embed, within the household, a first watermark in mediafrom a household source media device; a wireless access point within thehousehold to wirelessly retransmit the media with the first watermark; amobile device interface to detect audio output from a local presentationdevice, and to detect whether the first watermark is absent or presentin the audio output; and a data aggregator to identify the audio outputas unassociated with the household source media device when the firstwatermark is absent from the audio output, and to identify the audiooutput as associated with the household source media device when thefirst watermark is present in the audio output.
 12. An apparatus asdefined in claim 11, wherein the mobile device interface is to detect asecond watermark in the audio output from the local presentation device,the second watermark associated with broadcaster generatedidentification information.
 13. An apparatus as defined in claim 12,wherein the data aggregator is to determine the local presentationdevice is tuned to a local broadcast station when the second watermarkis detected and the first watermark is absent from the audio output fromthe local presentation device.
 14. An apparatus as defined in claim 12,wherein the data aggregator is to determine the household source mediadevice is not sourcing the audio output detected from the localpresentation device when the second watermark is detected and the firstwatermark is absent.
 15. An apparatus as defined in claim 11, whereinthe mobile device interface is to monitor the output from the localpresentation device for a personalized identification code accompaniedwith the first watermark.
 16. An apparatus as defined in claim 11,wherein the local presentation device comprises a handheld electronicdevice.
 17. An apparatus as defined in claim 11, wherein the localpresentation device is to receive the media from the household sourcemedia device wirelessly via the wireless access point.
 18. An apparatusas defined in claim 11, wherein the household source media devicecomprises at least one of a set-top box, a video game console, a digitalvideo recorder, or a digital versatile disk.
 19. An apparatus as definedin claim 11, wherein the wireless access point is to wirelesslyretransmit the media to the household presentation device via an 802.11compliant signal.
 20. A tangible machine readable storage device orstorage disk comprising machine accessible instructions that, whenexecuted, cause a machine to, at least: embed, within the household, afirst watermark in media from a household source media device;wirelessly retransmit the media with the first watermark via a wirelessaccess point in the household; detect audio output from a localpresentation device; identify the audio output as unassociated with thehousehold source media device when the first watermark is absent fromthe audio output; and associate the audio output with the householdsource media device when the first watermark is detected in the audiooutput.
 21. A machine readable storage device or storage disk as definedin claim 20, wherein the machine readable instructions further cause themachine to detect a second watermark in the audio output from the localpresentation device, the second watermark associated with broadcastergenerated identification information.
 22. A machine readable storagedevice or storage disk as defined in claim 21, wherein the machinereadable instructions further cause the machine to determine the localpresentation device is tuned to a local broadcast station when thesecond watermark is detected and the first watermark is absent from theaudio output from the local presentation device.
 23. A machine readablestorage device or storage disk as defined in claim 21, wherein themachine readable instructions further cause the machine to determine thehousehold source media device is not sourcing the audio output detectedfrom the local presentation device when the second watermark is detectedand the first watermark is absent.
 24. A machine readable storage deviceor storage disk as defined in claim 20, wherein the machine readableinstructions further cause the machine to monitor the audio output fromthe local presentation device for a personalized identification codeaccompanied with the first watermark.
 25. A machine readable storagedevice or storage disk as defined in claim 20, wherein the machinereadable instructions further cause the machine to receive the mediafrom the household source media device wirelessly via the wirelessaccess point.
 26. A machine readable storage device or storage disk asdefined in claim 20, wherein the machine readable instructions furthercause the machine to wirelessly retransmit the media to the householdpresentation device via an 802.11 compliant signal.